UPPER SEMICONTINUITY OF THE DIMENSIONS OF 
AUTOMORPHISM GROUPS OF DOMAINS IN C n 
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Abstract. Let TC n be the metric space of all bounded domains 
in C n with the metric equal to the Hausdorff distance between 
boundaries of domains. We prove that the dimension of the group 
of automorphisms of domains is an upper semicontinuous func- 
tion on 7i n . We also provide theorems and examples regarding 
the change in topological structure of these groups under small 
perturbation of a domain in Ti. n . 



0. Introduction 

The automorphism group Aut(D) (the group of biholomorphic self- 
maps of D) of a bounded domain D in C n is, in general, difficult to de- 
scribe and little is known about it. However, it is known (see [SZ, BD]) 
that any compact Lie group can be realized as the group of automor- 
phisms of a smooth strictly pseudoconvex domain, and (see [ShT]) that 
any linear Lie group can be realized as the group of automorphisms of 
a bounded domain. So, if we consider the group Aut(-D) as a function 
of D, the set of values is quite large. 

If one considers this function on the metric space 7i n of all bounded 
domains in C n with the metric equal to the Hausdorff distance between 
boundaries of domains, one can expect that small perturbation of the 
boundary may only "decrease" the group, i.e., the function Aut(-D) is 
"upper semicontinuous". Indeed, in [GK], [Ma] and [FP] the authors, 
using topologies different from 7i n , proved the upper semicontinuity 
of the function Aut(-D) in the sense that Aut(D) is isomorphic to a 
subgroup of Aut(-D) when D is "close" to D. But, in general, this idea 
is not true according to the following theorem ([FP]). 

Theorem 0.1. Let M be a domain in C n . Then there exists an in- 
creasing sequence of bounded domains Mk C Mk+i CC M such that 
M = UMfc and Aut(M^) contains a subgroup isomorphic to Z^. 
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This shows that domains in C n with an automorphism group contain- 
ing Z k are everywhere dense in H n , and it is well known that domains 
without non-trivial automorphisms are dense in 7i n . So arbitrarily 
small perturbation of a domain in 7i n may create a domain with a 
larger automorphism group. But, for all known examples, this group 
is discrete, so it is of dimension zero. The natural question arises: 
can small perturbation in H n create domains with larger dimensions of 
automorphism groups? 

In this paper we answer this question in the negative. Namely, we 
prove the following 

Theorem 0.2. The function dimAut(D) is upper semicontinuous on 
H n . 

An immediate consequence is the following 

Corollary 0.3. For each k > the set of all domains in 7i n whose 
groups of automorphisms have dimensions greater than or equal to k is 
closed and, therefore, nowhere dense. 

Thus a domain cannot be approximated by domains whose automor- 
phism groups have strictly larger dimensions. 

To prove Theorem 0.2 we consider a sequence of domains Dj con- 
verging in H n to a domain D. The identity components Aut (-Dj) of 
Aut(-Dj) have the same dimensions as Aut(-Dj). Also the dimensions 
of the Lie algebras of holomorphic vector fields generated by all one- 
parameter groups in Aut (-Dj) coincide with dim Aut (-D J ). Lemma 2.4 
states that the uniform norm of such fields on a compact set is bounded 
by its norm on an arbitrarily selected ball times a constant that, ba- 
sically, depends on the size of the ball and the distances from the ball 
and the compact set to the boundary of a domain. This allows us to 
normalize bases in Lie algebras of Auto(-Dj) and apply Theorem 2.5, 
which asserts the existence of non-trivial limits of those vector fields. 
The limits belong to the Lie algebra of Aut (-D) and this gives us the 
proof. 

It is reasonable to ask whether Aut (Dj) are always isomorphic to a 
subgroup of Auto(-D) when j is large. An example in Section 3 shows 
that the answer is negative. 

If Kj is a maximal compact subgroup of Auto(Dj), then Auto(-Dj) 
is diffeomorphic to Kj x ~R kj (see [MZ, p. 188]). The groups Kj may 
decrease or even disappear in the limit (see Example 3.2), while non- 
compact parts never vanish (see Theorem 3.3). 
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1. Some basic facts 



Let D be a bounded domain in C n . If the Lie group Aut(D) has 
positive dimension, then it has one-parameter subgroups g(-,t), — oo < 
t < oo, i.e., g(z, t + s) = g(g(z,t), s). Such subgroups generate vector 
fields 

X(z) = ^(z,Q) 

that are holomorphic. Also, if X is a holomorphic vector field on D 
that is M-complete, i.e., the initial value problem 

^(z,t)=X(g(z,t)), g(z,0) = z 

has a solution on D x R, then g(z,t) is a one-parameter group. 
The vector field X has the following group property: 

X(g(z,t)) = f z (z,t)X(z). (1) 

For every two points z and w in D among all holomorphic mappings 
of D into the unit disk A we choose holomorphic functions / such that 
f(w) = and f(z) is real and the maximal possible. Such functions / 
exist and are called Caratheodory extremal functions for z and w on 
D. The quantity 

is called the Caratheodory distance cd(z,w) on D. (Note that the 
formula for p(0, a) gives the Poincare distance between and a in the 
unit disc.) When D is bounded this distance is non-degenerate and 
invariant, i.e., cr>(g(z), g(w)) = c D (z,w) for every g e Aut(D) (see 
[Sh, Ch. 5, §18]). 

For a point w G D and a vector Y in C n , among all holomorphic 
mappings of D into the unit disk A we choose holomorphic functions 
/ such that f(w) = and (f'(w), Y) is real and the maximal possible. 
(Here (Z, Y) = Y^=i z jUj-) These functions are Caratheodory extremal 
functions for Y at w in D. The Caratheodory length of Y at w is defined 
to be C D (w,Y) = (f'(w),Y). It follows from [Sh, Ch. 5, §18] that if 
w(t) is a smooth curve in D with w(0) — w and Y = w'(0), then 

c D (w,w(t)) = C D (w,Y)t + o(t). (3) 

Let B(w,r) be the ball of radius r centered at w and let \Y\ be the 
Euclidean norm of Y. If B(w,r) C D C B(w,R), then 

l -^<C D (w,Y)< 1 -^. (4) 



2. Proof of Theorem 0.2 

Lemma 2.1. Let D be a domain in C™ and let d(z,w) be an invariant 
metric on D satisfying the triangle inequality. If g(z,t) is a group 
action on D, then for any w,z G D 

\d(g(w,t),z) - d(w,z)\ < d(z,g(z,t)). 

Proof. Apply the identity d(w,z) = d(g(w,t), g(z,t)) and the triangle 
inequality. □ 

Lemma 2.2. Let w G B(w,r) CC D CC B(w,R) CC C n . Then for 
anyY e C\ \Y\ = I, 

Re (v/»,y)>^, 

where f s (z) is a Caratheodory extremal function for w and w + sY in 
D, and s is a real number such that 

< s < e = — -. 

16R 

Proof. Let us fix Y and introduce D Y = {£ G C : w + £Y G D}. 
Clearly, A(0,r) CC D Y CC A(0,R), where A(0, s) is the disk of 
radius s centered at 0. 

Let gy{z) be a Caratheodory extremal function for Y at w in D. 
For £ G -Dy we introduce the functions = ReF(£), where F(£) = 
/ s (w + £y), and 7,(0 = ReG(0, where G(0 = + £Y). All 

these functions are well-defined on Dy and -F(O) = G(0) = 0, G"(0) = 
C D (w,Y) and u(s) = F(s) > v(s). Let us prove that v(t) > t/{2R) 
when t G [0, e]. Since 

\v(t)-v'(0)t\ < - sup \v"(x)\ -t 2 , 
2 o<x<e 

£ < r 2 /(16i?) < r/2 and by Cauchy estimate < 2/(r — e) 2 when 

x < e, we see that 

v(t) > v'(0)t - 1 A 2 > v'(0)t - -J 2 . 

(r — ey r A 

Since t < r 2 /(\QR) and by (4) 

v'(0) = G'(0) = C D (w,Y)>± 



for < t < e. In particular, 

^) = ReG( s )>^. 
Applying to the function u(t) the same analysis as above we obtain 

u(s) < u'(0)s+ ^s 2 . 



Hence 



2^ < v(s) < u(s) < u'(0)s + -s 2 < u'(0)s + — . 



Thus 

Re(V/,H,y) =ReF'(0) = u'(0) > ^. 



□ 



Lemma 2.3. Let 5(0, r + a) CC D CC 5(0,5), r, a > 0. Then there 
exists a positive 5 = 5(a, r,R) < a such that 

uxu < 32R \\x\\ 

II A \\B(0,r+6) S ||A ||B(0,r) 

/or every holomorphic vector field X generated by a one-parameter 
group action g(z,t) on D. 

Proof. Let w belong to 5(0, r + a/2). Since 

w e B{w,a/2) CC D CC B(w,2R), 

by Lemma 2.2 there is an e = e(a, R) > such that for every w G 
5(0, r + a/2), every F G C n , |F| = 1, and every s G (0,5] 

Re(V/H,y)>^, (5) 

where / is a Caratheodory extremal function for w and w + sF. 

Let us take a positive number 5 < a/2 so small that for every w G 
5(0, r + 5) and every unit vector V there is a unit vector Y such that 
w + sY E B(0, r) for some real s with |s| < e and 

|y-y|<6 
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Clearly, the choice of this S depends only on a, r and R. 

The lemma needs a proof only for non-trivial group actions when 
X £ 0. Let w G 95(0, r + 5), X(w) + and let V = X(w)/\X(w)\. 
We choose a vector y and a real s satisfying the above conditions. 

Let / be a Caratheodory extremal function for w and z = w + sy. 
Since B(w,a/2) CC 5, by Schwarz inequality, 

|Re(v/H,y-y)| < 6|v/H| < -. 

a 
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Hence by (5), 

Re (V/H, V) > Re (V/H, F) - ^ > ^ - ^ 
Let = f(g(w,t)) and p = /(z). We introduce 

C(*)-p 



16i? 



m(t) = 



If p(C,0 is the Poincare metric on [/, then p(0,p) = cd(z,w) and 

x 1, l + m(t) 

p(C(t) ' p) = 2 ln T^(t)- 

A straightforward calculation shows that 
dm 2 



dt 



.(0) = -2p(l-p 2 )Re(Vf(w),X(w)), 



and, by using this calculation, we obtain 



^(C(0),p) = -Re(V/W,XW). 



Hence 



p(((-t),p) > p(0,p) + tRe (Vf(w),X(w)) > c D (z,w) + t^\X(w)\ 

for small positive t. Since the Caratheodory metric decreases under 
the holomorphic mapping /, 



t 



c D (z,g(w, -t)) > p(((-t),p) > c D (z,w) + — — \X(w 



16R' 



(6) 



By (6) and Lemma 2.1, 
t 
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X(w)\ < c D (z,g(w, -t)) - c D (z,w) < c D (z,g(z, -t)). 



By (3), c D (z,g(z, -t)) = C D (z , X (z))t + o(t) . Note that B(z,a) C D 
and, therefore, Cd(z, X(z)) < 1/a. Hence 

c D {z,g(z,-t)) < 2C D (z,X(z))t < -\X(z)\t 

CL 



for small positive t. Thus 



\X(w)\ < 



32R 



X(z) 



and 



mi < 32R \\x\\ 



□ 



Lemma 2.4. Let R > 2r > 2s > 0. Let K be a connected compact 
set containing in C n . Let D be a domain in C n such that B(0, 2r) C 
D C B(0,R) and such that the 3s -neighborhood of K is contained in 
D. Then there exists a positive constant C = C(K,R,s) such that 
\\X\\k < C||^||s(o,r) f or eac h holomorphic vector field X generated by 
a one-parameter group action g(z,t) on D. 

Proof. Let X be such a vector field on D. By the previous lemma there 
exist positive numbers 5 = S(s, R) < s and c = c(s, R) such that 

||^||b(2,s+<5) < c||X||b( 2 ,s) 

whenever z G D is at least 3s away from 3D. There is a positive 
integer iV = N(K, 5) such that for each z G K there is a set of 
points {zi, . . . , Zn} C K with z\ = 0, Zn = z, and \zk+i — Zk\ < S for 
k — 1, . . . , N — 1. Since B(z k+1 , s) C B(z k , s + 5), we see that 

\\X\\ B (z k+1 , S ) < c\\X\\ B (g k ,s) 

for k = 1,...,N- 1. Thus, 

In particular, |-X"(z)| < c^ -1 ||-X"||s(o,s) < c^" 1 ||X|| B ( 0jr ). Therefore, 

||^lk<C JV - 1 ||X|| B (0 1 r). □ 

Theorem 2.5. Suppose a sequence of domains Dj converge in H n 
to a domain D and a ball B(p,r + a), r,a > 0, belongs to all Dj. 
Also suppose that gj(z,t) are non-trivial one-parameter group actions 
on Dj generating the holomorphic vector fields Xj. If \\Xj\\s = 1, 
B = B(jp,r), then there is a subsequence of the group actions gj k (z,t) 
that converges to a non-trivial group action g(z,t) on D uniformly on 
compacta in D x R and 

\\™X jk {w)=X{w) 

k—i-oo 

uniformly on compacta in D, where X is the holomorphic vector field 
generated by g. 

Proof. Let K CC D. Choose 5 > so that the 35-neighborhood of 
K is contained in D and in each Dj. Let K and K denote the 28- 
neighborhood and the ^-neighborhood of K respectively. By Lemma 
2.4 there exists A > such that < A. 

Let r = 5/ (2A). Define the mapping h j : K x (— r, r) — > Dj as the 
solution of the initial value problem 

d 

-^hj(z,t) = iXj(hj(z,t)), hj(z,0) = z. 

7 



Since t\Xj\ < 5 in K, it follows from the ODE's theory that the map- 
ping hj is well-defined. 

For M = {( E C : |ImC| < r} we define G, : K x M -> by 
Gj(z, t + is) = gj(hj(z, s),t). Since Xj is holomorphic, the mapping Gj 
is holomorphic in z. We now prove that it is holomorphic in ( = t + is. 
It is clear that 

dC 

-^(z,t + i8)=X j (G j (z,t + i 8 )). (7) 

It follows immediately from the fact that the Poisson brackets [Xj,iXj] = 
0, that 

8C 

-^-(z,t + is)=iX j (G j ((z,t + is)). (8) 
This fact also can be proved by a straightforward reasoning: 

^(z, t + is) = |j(M*> s )it)- iX{hj(z, s)) 

= iX j (g j (h j (z, s),t))= iXj(Gj(z, t + is)); 

the middle equality is by the infinitesimal group property (1). The 
equations (7) and (8) are the Cauchy-Riemann equations for Gj in (. 
So Gj is holomorphic. 

Passing to a subsequence, if necessary, we may assume that the map- 
pings Gj converge to a mapping G uniformly on compacta in K x M. 
Consequently, the mappings gj(z,t) converge to g(z,t) uniformly on 
compacta in K x R, and the vector fields Xj converge to 

X(z) = ^(z,Q) 

uniformly on compacta in K. 

It follows that some subsequence of the sequence {gj(z, t)} converges 
to a mapping g(z, t) = G(z, t) uniformly on compacta in D x R. Thus, 
g(z,t) is a group action. Since = 1, this group action is non- 

trivial. □ 

Proof of Theorem 0.2. Let Dj be a sequence of domains converging in 
H n to a domain D. Let us choose a ball B(p, r + a), r,a > 0, belonging 
to all Dj for sufficiently large j and take S > from Lemma 2.3. Let 
B = B(p,r) and B = B(p,r + 5). We may assume that the dimensions 
of all groups Gj = Auto(-Dj) are the same and equal to k. Since the 
Lie algebra Aj of all holomorphic vector fields on Dj generated by 
one-parameter subgroups in Gj has the same dimension as Gj, we can 



choose Xj 1 G A,-, 1 < m < k, such that 

J{Xf ) X))dV = 5 mU 

B 

where 5 m i is Kronecker's delta. 

Clearly, HXj"^ > Vol(fi) -1 . On the other hand, by Cauchy esti- 
mates and Lemma 2.4, for some constants we have 

i^c^xfWB^c^xfW^. 

Let g™ be the one-parameter groups generated by X™. By Theorem 
2.5 one can choose a subsequence {jk} such that converge, uniformly 
on compacta in D x R, to a one-parameter group g m (z,t) on D, and 
X™ converge to a vector field X m uniformly on compacta in D. Since 

J(X m ,X l )dV = 5 ml , 

B 

the dimension of Aut (-D) is at least k. 

3. Structural theorems 

By Iwasawa's theorem (see [MZ, p. 188]) the group Auto(-D) is dif- 
feomorphic to K x R k , where K is a maximal compact subgroup and 
k is the characteristic number of Aut(D). It is interesting to find out 
what happens with K and R fc under small perturbations of domains. 
Let us look at maximal compact subgroups first. The argument of 
Corollary 4.1 in [FP] provides the following theorem. 

Theorem 3.1. Let D be a bounded domain in C n , let zq be a point in 
D, and let W be a compact set in D. If D is sufficiently close to D in 
7i n and for some maximal compact subgroup K in Aut (D) the orbit 
K(z ) C W , then K is isomorphic to a subgroup of Auto(-D). 

Next example shows that without the condition in the above theorem 
of orbits being contained in a fixed compact set, it is possible that 
Aut(-D) does not contain a compact subgroup while close domains have 
Auto(-D) isomorphic to S 1 . Let A denote the unit disc in C. 

Example 3.2. There is a sequence {Dj} of bounded pseudoconvex do- 
mains in C 2 converging to a domain D such that Aut(-Dj) = S 1 for 
each j, and Aut(£>) = R. 

Construction. Let Qj = {z e A : \z - 2" 1 + 2~ j \ > 1/2}, Q = 
{z G A : \z - 2- l \ > 1/2}, Dj = {{z,w) : z G Qj,w G A,w ^ z}, 
D = {(z,w) : z G Q,w G A,w ^ z). 
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1. One can see that Dj — > D. 

2. The domains Dj and D are bounded and pseudoconvex. 

3. We now prove that Aut(D) = R. Let F G Aut(D). On each 
fiber (z, •), F is bounded and has an isolated singularity, so F extends 
to be an automorphism of Q x A. Thus, F has the form F(z,w) = 
(f(z),g(w)), or F(z, w) = (g(w), f(z)). For both cases, one has, by the 
definition of D, that 

f(z)=g(z), zeQ. (9) 

The second case is impossible, since implies that f(Q) = A, g(A) = Q, 
and f(Q) = g{Q), which leads to a contradiction that A coincides with 
a subset of Q. Therefore, F has the form F(z, w) = (f(z),g(w)), where 
/ G Aut(Q), g G Aut(A). By (9), / = g\ Q . Let cj)(w) = -i(w + l)/(w- 
1). Then is a biholomorphic map from A to the upper half-plane 
II = {( G C : Im( > 0}, and <j>{Q) = A e {( e C : < Im( < 1}. 
Now o g o cj)~ l is an automorphism of II, and its restriction to A is an 
automorphism of A. Thus 0ogo0 _1 (£) = £+t for some t G R. It follows 
that Aut(D) = {F t : t G R} = R, where F t (z,w) = (g t (z) , g t (w)) , and 

/x ,-1 / , / \ ,\ 2w + i(w - l)t 

«,(«.)=* ■(«(»)+ 1) = 2+ ^,_ 1) ; . 

4. In a way very similar to the above argument, one can prove that 
Aut(Dj) = for each j. □ 

By Theorem 0.2 the creation of compact subgroups with larger di- 
mensions by small perturbations must be compensated by an elimina- 
tion of some non-compact subgroups so that the total dimension will 
not go up. It seems to us that the other way around is impossible: char- 
acteristic numbers are upper semicontinuous on Ti n . While we cannot 
prove this statement, the following theorem certifies that non-compact 
parts cannot be created from nothing. 

Theorem 3.3. Let D C C n be a bounded domain such that Aut (-D) 
is compact. Then for all D sufficiently close in Ti n to D the group 
Auto(-D) is also compact. 

Proof. If the statement is not true, then there is a sequence {Dj} of 
domains converging to D such that for each j the identity component 
Gj = Auto(-Dj) is noncompact. Write G = Aut (-D). Fix a z G D. 
The orbit G(zq) is compact. We may assume that G(zq) C Dj for 
each j. For each connected component H of Aut(D), either the set 
H(zo) coincides with G(z ) or G(zq) H H(z ) = 0. Indeed, if h G 
H and h(z ) G G(z ), then H(z ) = Gh(z ) = G(z ), since H = 
Gh. Now we claim that there exists a positive number a such that 
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a < d(H(zo),G(z )) for each component H of Ant(D) with H(z ) ^ 
G(z ), where d is the euclidean distance. Otherwise, there is a sequence 
{HjS\ of distinct components of Aut(D) with Hj,(z ) ^ G(z ) such 
that d(Hk(zo),G(zo)) — > 0. Passing to a subsequence if necessary, we 
may assume that there are hk G Hk such that hk(z ) tends to a point 
in G(zo). It follows that some subsequence of {hk} converges in the 
compact-open topology to a g G Aut(D); but this is impossible because 
hk belong to different components of the Lie group Aut(D). Therefore, 
such an a exists. Decreasing a if necessary, we see that the open set 

V = {z G D : d(z,G(z )) < a} 

is relatively compact in D and in each Dj, and satisfies Vr\Aut(D)(zo) = 
G(zo). This implies that dV D Aut(D)(zo) = 0. Since Gj is noncom- 
pact, Gj(z ) is noncompact, hence Gj(z ) fl dV ^ 0. It follows that for 
each j there is a ^ G Cj with gj(z ) G 9V. Some subsequence of the 
sequence {gj} converges uniformly on compacta to a g G Aut(D). It is 
clear that g(z ) G dV, contradicting dV fl Aut(D)(z ) = 0. □ 
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